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SYSTEM AND METHOD FOR VISUAL 
REPRESENTATION AND MANIPULATION OF PAGE 
FEATURES ON A PRODUCTION PRINTER 

BACKGROUND 

While just about every computer user owns their own printer and is capable 
of producing high quality documents, the ability to produce such documents in 
high volume and with special finishing features, such as binding, is still within the 
purview of the commercial print shops and corporate copy departments due to the 
high cost and operational complexities involved. High volume, finished 
production of documents is typically referred to as production printing. A 
production printer is a printing device capable of rapid continuous production of 
large volumes of documents. Typically these printers have high paper handling 
capacity, the ability to draw on multiple media types from multiple sources and the 
ability to automatically finish a document such as by adding a binding. Despite 
the automation provided by the production printer and the proliferation of 
computer technology, especially in the area of desktop publishing, production 
printing is still a complicated and often manual process. 

In a typical print shop, customers bring in original documents which they 
want turned into a finished product such as a bound booklet, a tri-fold brochure or 
a tabbed three ring bound notebook. In addition, they typically need a large 
volume of the finished product, for example, one thousand brochures. The 
combination of the original documents plus the instructions for producing the 
finished product is called a "job". The documents can be brought in either in hard 
copy or electronic form, such as on floppy disk, compact disc or tape or can be 
transmitted to the print shop over a network such as the Internet. 

After handing over the documents to the clerk, the customer relays his 
instructions for preparing the finished product. The clerk will note these 
instructions on a "ticket" or "job ticket". The job ticket is typically a piece of 
paper with all of the instructions written on it for producing the finished product. 
As mentioned above, this is known as job. The job will then be handed to an 
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operator, who runs the production printer, to produce the finished output. The 
operator's job is to prepare the document for production, load the appropriate 
materials, such as paper stock and binding materials, into the production printer 
and ensure that the finished output is correct. 

While the job of the operator seems simple, there are many issues which 
quickly complicate it. Often, the documents provided by a customer are not ready 
to be run on the production printer. Some documents provided by a customer are 
merely raw manuscripts requiring basic formatting, such as margins, typography, 
etc. Other documents may be formatted but such formatting might not take into 
account the requested binding. For example, the text of the document is too close 
to the margin, therefore, when the finished product is bound, some of the text will 
be obscured. Some documents, such as books, require special care so that, for 
example, the first page of every chapter appears on the front of a page, also known 
as imposition. Other forms of imposition include booklet/pamphlet imposition or 
n-up imposition. Or the customer may bring in multiple documents and ask that 
these "chapters" be assembled into a book, with a cover and binding. 

Other issues which complicate the production printing job are determining 
and loading the correct media into the production printer. Often, jobs will require 
many different paper types, such as different stock weights or different colors. In 
addition, some jobs require the insertion of tab stock at specific points within the 
document. Still other jobs may require the adding of a bates number or other 
annotation to the document. 

With such a complicated production process to produce finished output, 
errors are bound to occur, such as loading the wrong paper stock in the printer or 
setting a margin too close to a binding. Production printers run at very high 
speeds, often producing output greater than 1 page per second therefore, errors in 
the finished output may not be caught before a significant amount of time and 
resources have been wasted. 

Accordingly, there is a need for an efficient system and method for 
managing production printing and ensuring error-free output. 
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SUMMARY 

The present invention is defined by the following claims, and nothing in 
this section should be taken as a limitation on those claims. By way of 
introduction, the preferred embodiments described below relate to an interface, 
5 implemented in a computer, for controlling a production printer comprising: a 

display and a first page representation located on the display and operative to 
represent a portion of a document to be produced by the production printer. The 
portion is characterized by the applicability of one or more media/finishing 
attributes. The interface further comprises a first attribute representation 
~^10 associated with a first of the one or more media/finishing attributes and located on 

jff the display. The first attribute representation comprises a first indicator operative 

03 to visually indicate on the display, the applicability of the one or more 

u= media/finishing attributes to the portion. 

Jjf The preferred embodiments further relate to a method, implemented in a 

s 1 5 computer, for controlling a production printer comprising a display. The method 

H comprises displaying a page representation on the display representing a portion of 

y a document to be produced by the production printer. The portion is characterized 

O by the applicability of one or more media/finishing attributes. The method further 

comprises indicating, visually, on the display, the applicability of the one or more 
20 media/finishing attributes to the portion. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 depicts a flow diagram illustrating a preferred production printing 
25 workflow. 

FIG. 2 depicts a flow diagram showing the user functionality workflow of 
the preferred embodiment 

FIG. 3 depicts a graphic user interface according to a first embodiment. 

FIG. 4 depicts a graphic user interface according to a second embodiment. 
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FIG. 5 depicts a library of symbolic icons representing various 
media/finishing attributes for use with the embodiment of Figure 4. 


DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED 
EMBODIMENTS 


Referring now to Figure 1, there is shown a flow diagram illustrating the 
production work flow 100 in a typical production print shop such as a commercial 
high volume copy or print shop. A workflow is defined as the tasks, procedural 

10 steps, organizations or people involved, required input and output information, and 

tools needed for each step in a business process. A workflow approach to 
analyzing and managing a business or process such as production printing can be 
combined with an object oriented approach, which tends to focus on the discrete 
objects and processes involved such as documents, pages, data and databases. For 

15 the purposes of this disclosure, the term "object oriented", when applied to the 

disclosed embodiments, does not imply that an object oriented programming 
approach is the only method of implementation of the disclosed embodiments. 

Figure 1 further depicts a typical computer network 1 12 for use in a print 
shop. In a typical digital print shop, there will be a network 1 12 of computer work 

20 stations 114, 116, servers 118, 120 and high volume output devices 122 which 

make up the computer network 1 12. The servers 1 18, 120 include network servers 
1 18 and print servers 120. The topology of the network 1 12 is typically structured 
so as to align with the workflow 100 of the print shop. The network 1 12 may be 
implemented as a wired or wireless Ethernet network or other form or local area 

25 network. Further the network 112 may include wired or wireless connections to 

wide area networks such as the Internet and connections to other local area 
networks such as through a virtual private network. 

The production workflow 100 includes the procedural stages of job 
origination 102, job submission 104, job preparation 106, print production 108 and 

30 final fulfillment 1 10. Alternatively, one or more of these procedural stages may 
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be combined as well as there may be other additional procedural stages. Job 
origination 102 is the procedural stage of receiving the documents and 
instructions, which together are defined as a "job", from the customer. Job 
origination 102 can occur when a customer physically brings his job, whether in 
hard copy or electronic form, to the print shop or otherwise transmits the job to the 
print shop, whether by phone, fax> postal mail, electronic mail or over a local area 
or wide area network such as over the Internet. Note that a job may contain more 
than one document and more than one set of instructions. For example, a job may 
contain many documents, each being one chapter of a book, along with a 
document containing a cover for the book. This exemplary job may include the 
instructions for producing the body of the book from the individual chapter 
documents and another set of instructions for producing the cover. In addition, 
there may be a third set of instructions for assembling the cover to the body of the 
book. 

Job submission 104 is the receipt of the job by the print shop and the 
entering of the job into the print shops production system or workflow. Typically 
the instructions from the customer will be written down on a special form, known 
as a "ticket" or "job ticket". A ticket may also be electronically created and 
maintained. Furthermore, pre-defined tickets may be available for standardized 
instructions. For example, the shop may have a pad of pre-printed tickets with the 
instructions to duplicate the documents, three hole punch the final output and 
assemble the punched final output in a three ring binder. If this is a common 
request by customers, such pre-printed tickets can save time and resources. All 
the order taking clerk need do is fill in any customer specific details such as the 
number of copies to produce. Pre-defined tickets standardize operations and 
prevent errors in the transcription of instructions from the customer. In very 
simple print shops, job submission 104 may simply be the receiving of the original 
documents and instructions along with the creation of a ticket, placing the job in a 
paper folder and setting it in a physical queue for later handling in subsequent 
procedural stages. 


In print shops which handle jobs electronically, job submission 104 
requires entering the job into the shops electronic production system. For 
documents which are brought in by the customer as hard copy, the documents 
must first be scanned electronically into the shop's computer system. For 
documents delivered in electronic form, the document data files must be loaded on 
the shop's computer system. 

For the job submission stage 104, the computer network 112 will include 
one or more "store front" workstations 114. The store front workstations 114 are 
computer systems placed at the order taking desk, at a maimed clerk's station or 
set out for customer self service use. These workstations 114 are used for the job 
submission stage 104 and typically will be configured to handle many different 
electronic media types such as floppy disk, compact disc, tape, etc. These stations 
114 may also be configured to receive jobs over the Internet or other form of 
network connection with customers. Further, these workstations 114 are typically 
configured to read many different electronic file formats such as those used by the 
Microsoft Office™ family of products manufactured by Microsoft Corporation, 
located in Redmond, Washington or various other desktop publishing program file 
formats such as Aldus Pagemaker™ or QuarkXpress™. In addition, these stations 
114 can also read "ready for printer" file formats, which will be discussed later, 
such as Portable Document Format™ ("PDF"), Postscript™ ("PS") or printer 
control language ("PCL"). Job preparation stations 114 can also accept image 
formats such as Tagged Image File Format ("TIFF"), bitmap ("BMP") and PCX. 
These stations 114 may also include a scanner 1 16 for scanning hard copies of 
documents into the computer system. Scanners typically are complicated devices 
to operate and some print shops may prefer to locate the scanners in the job 
preparation stage 106 for use solely by trained personnel as will be discussed 
below. In addition, the store front computers 1 14 also provide the ability to 
generate a ticket, electronically or in hard copy form, for the job containing all of 
the instructions for completing the production printing task. This process of 
generating the ticket may be automated, involving pre-defined tickets, manual or a 
combination thereof, and is discussed in more detail below. 


Job preparation 106 involves preparing the documents for printing 
according to the instructions in the ticket. For documents that are submitted in 
hard copy form, job preparation 106 may include scanning the documents and 
creating a faithful and error free electronic reproduction. The documents, once in 
electronic form, must also be distilled down or converted into a common file 
format that the print shop can use to both edit and print the documents. This 
. alleviates the need for operators to deal with multiple different programs and 
eliminates the need to assemble complex documents together for printing using 
different electronic file formats. 

For example, a customer may bring in two different documents, one being 
the body of a book and the other being the photographs to be inserted at specific 
pages. The customer may then instruct that the photographs be inserted at 
particular pages and that the final assembly have continuous page numbers added. 
The body of the book may be in Microsoft Word™ format while the images of the 
photographs are in Adobe Photoshop™ format. While the operator could figure 
out at which pages the images will be inserted and appropriately number the pages 
of the book and photographs using each individual software package, this is a very 
complex and time consuming process. It also requires that the operator be trained 
and familiar with a range of software packages and runs the risk that he will not be 
familiar with the particular package that the customer used. Therefore, it is more 
efficient to distill each of the various file formats into a unified format which 
allows the operator to prepare the job using a single software interface. In the 
preferred embodiments, all documents, whether provided in hard copy or 
electronically, are distilled or converted into a "ready for printer" or "print ready" 
file format. In the preferred embodiments, the Portable Document Format™ is 
used as the ready for printer format, developed by Adobe Systems, Inc., located in 
San Jose, California. 

A ready for printer file format is defined as a file format which contains 
both the data to be printed along with printer control instructions that can be 
directly interpreted by the internal processing engine of a printer or other form of 
hard copy output device in order to rasterize the data image onto the output media. 
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Rasterization is the placement of image data at a specific location on the output 
media. Such file formats include Portable Document Format™ ("PDF") and 
Postscript™ ("PS") both manufactured by Adobe Systems, Inc., located in San 
Jose, California, as well as printer control language ("PCL"), manufactured by 
5 Hewlett Packard, located in Palo Alto, California. Examples of non-ready for 

printer formats include the native application file formats for personal computer 
application programs such as Microsoft Word™. These file formats must be first 
converted to a ready for printer file format before they can be printed. 
Furthermore, some image file formats, such as the Tagged Image File Format 
„J 0 ("TIFF") contain bit image data only which is already in a format which specifies 

its output location on the output media and does not contain printer control 
m instructions for interpretation by the internal processing engine of the printer and 

[\ therefore, for the purposes of this disclosure, is not a ready for printer file format. 

By using a ready for printer format, rasterization of the image data can be delayed 
5 15 as close as possible to the final placement of the image data on the output media. 

q This allows the most efficient use of the production print device 122 by allowing 

y its internal control logic to optimize the rasterization process resulting in output 

Q that is more likely to match with the operator's expectations. 

^ For the job preparation stage 106, the computer network 106 includes job 

20 preparation stations 116 and network servers 118 coupled with the store front 

workstations 114 over the network 112. Herein, the phrase "coupled with" is 
defined to mean directly connected to or indirectly connected with through one or 
more intermediate components. Such intermediate components may include both 
hardware and software based components. The job preparation stations 116 
25 preferably execute workflow management software, described in more detail 

below, which allows the operator to manage, edit and print jobs. The network 
server(s) 118 includes a document library which allows manipulation, 
management, storage and archiving of jobs, or just there respective documents 
and/or tickets, as well as facilitates and manages the flow of jobs from the store 
30 front computers 1 14 to the job preparation stations 116 and from the job 

preparation stations 1 16 to the print servers 120 or the production output devices 
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122. Exemplary document libraries include Intra.Doc™ document management 
system manufactured by Intranet Solutions, Inc., located in Eden Prairie, 
Minnesota and the DOCFusion document management system manufactured by 
Hummingbird, Inc., located in York, Ontario, Canada. In the preferred 
5 embodiment, the job preparation stations 1 16 are Imagesmart™ Workstations, 

manufactured by Heidelberg Digital, L.L.C., located in Rochester, New York. 
Alternatively, an appropriate computer hardware platform such as that comprising 
a Pentium™ class processor or better, manufactured by Intel Corporation, located 
in Santa Clara, California, 64 megabytes of RAM or more, a 20 gigabyte hard disk 

10 or larger and appropriate display device may be used. Further, in the preferred 

embodiment, the network servers 118 preferably comply with the Open Document 
Management Architecture ("ODMA") standard and provide document 
management capabilities and scaleable storage. 

The job preparation workstations 116 also provide the capability of the 

1 5 print shop to add value to the print production process by offering services to the 

customer. Such services include the ability to modify documents provided by the 
customer to add features that the customer could not or would not add himself. 
Such features include adding pagie numbers across multiple documents, bates 
numbering, adjusting page layout for tab stock and aligning the output to account 

20 for binding. Further the job preparation stations 1 14 provide the capability to fix 

errors in the documents such as removing artifacts in scanned images and masking 
over unwanted text or markings. The job preparation stations 114 can also be used 
to prevent inaccuracies in the finished output caused by the printing or binding 
process. Such inaccuracies include binder's creep which happens after a 

25 document is imposed into a booklet/pamphlet using a signature imposition. 

Binder's creep occurs when the placement of the images on the paper fails to 
account for the thickness of the binding as a function of the number of pages in the 
book causing the image on the pages to shift inward as you get closer to the cover. 
Binder's creep is prevented by gradually shifting the image placement over the 

30 range of pages when performing the signature imposition on the document. In 

addition, the job preparation station 116 allows the operator to manage and layout 
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the document pages for final output, also known as "imposition" and "signature 
imposition". In addition, the operator can shuffle pages, reverse pages, insert 
blank pages, trim and shift pages, create bleeds and place multiple pages on a 
sheet, also known as "n-up" to create proof sets, brochures or pamphlets, etc. 
Further the job preparation station 116 permits the operator to add annotations to 
the document such as bates numbers, page numbers, logos and watermarks. All of 
these service add value to the final output. Formatting and other modifications to 
the document can be globally applied to the entire document, such as a shifted 
margin or may be applied only to select pages. Such alterations to the document 
are known as document/page features or attributes. Further, these alterations are 
also known as document or page exceptions since they typically override specific 
instances of the original document formatting as set by the customer. 

The next stage in the print production workflow 100 is the print production 
stage 108. In the print production stage 108, the final form of the documents for 
printing is sent to a print server 120 which will distribute the job to the final output 
device 122. In manual print shops, this stage 108 would be similar to an operator 
manually taking the ready for production job over to the desired output device 122 
to start the job. The print production stage 108 manages the output resources of 
the print shop. Such management includes queuing jobs to the proper devices 122 
in the shop, routing jobs to available devices 122, balancing the load placed on the 
various devices 122, and pre-processing jobs, such as splitting or RIP'ing the job, 
prior to sending it to a particular device 122. RIP stands for Raster Image 
Processor and is the hardware and/or software which converts ready for printer 
data into raster images. It is also a common term for rasterizing a page image on 
to the output media. 

The print server 120 used in the print production stage 108 is coupled with 
the job preparation stations 116 and the network server 118 over the network 112. 
Further, the print server 120 is coupled with the various output devices 122 in the 
print shop. Note that some output devices 122 may not support electronic transfer 
of the data to be output and may require a manual step for operation. Such devices 
may include a special binding machine which requires that the partially finished 
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documents be manually transferred to the binding machine to complete the 
production. The print server 120 is preferably implemented as a separate 
computer coupled with the network 112, however, software based print servers 
running on a network server 118, job preparation station 1 16 or store front 
workstation 114 may also be used. In the preferred embodiment, the print server 
120 includes an independent computer workstation, typically running a UNIX or 
Windows NT operating system, a software print server engine and a software print 
server application. The print server application offers the user interface ability to 
configure and manage the print server operation. The print server engine performs 
the automated processes of the print server. These processes include spooling and 
queuing jobs and job content (i.e. the document), directing the jobs to specific 
production output devices based on the attributes of the print job and how these 
attributes are satisfied by the print engine, load balancing jobs among the various 
production output devices to keep all printers fully utilized, e.g. to split color from 
black and white jobs, and acting as a communication gateway where it can accept 
multiple input communication and print protocols translating them to the 
communication and print protocol the production output device 122 understands. 

The final stage of the production printing workflow i00 is the final 
fulfillment stage 110. The final fulfillment stage 1 10 is the stage where the 
finished output is produced on the production output device 122. A production 
output device is a computer output device, such as a printer, designed for high 
volume production of printed documents. Such devices preferably include the 
ability to produce large quantities of documents with mixed media types and 
various degrees of finishing, such as stapling or binding, at very high speed. 
Exemplary output devices include the Digimaster™ Digital High Volume Printer 
manufactured by Heidelberg Digital, L.L.C., located in Rochester, New York and 
the NexPress™ Color printer manufactured by NexPress, Corporation, located in 
Rochester, New York. 

Referring now to Figure 2, there is shown a flow diagram showing the user 
functionality workflow 200 of the preferred embodiment job submission and 
preparation stages 104, 106. The user workflow 200 includes an input source 
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stage 202, a preflight stage 204 and a production stage 206. In the input source 
stage 202, all of the documents of the job are collected together from the different 
input sources 208. As detailed above, all of the collected documents are converted 
to a ready for printer format, preferably a Portable Document Format™. This 
conversion can be a manual or automated process or a combination thereof. For 
example, a special directory can be created on the network server 118 where data 
files in various file formats can be placed, for example, by the clerk who accepts 
the documents from the customer and inputs them into the store front workstation 
114. Automated logic which watches this directory, will see the placement of files 
and automatically convert them (or flag them for manual conversion) into a ready 
for printer format. Any documents which the automated logic cannot handle can 
be flagged for manual conversion. The converted documents are then passed to 
preflight stage 204 where they are prepared for production. This transfer of 
converted documents can occur by moving the documents to a special directory on 
the network server 118 where they can be accessed by the job preparation stations 
1 16 or by transmitting the documents to the job preparation station 116. This 
process can be manual or automated and may involve placing the documents in a 
queue of documents waiting to be prepared for production. Further, this process 
may include a manual or automated determination of the capabilities, skill level or 
training level of the various operators currently logged into the available job 
preparation stations 1 16 as well as the current load/backlog of job in their 
respective queues. Taking these factors into account, job can be automatically or 
manually routed to the operator best able to handle the job both technically and in 
an expedient manner. This functionality can be implemented by creating an 
operator database which tracks the capabilities, skill level and training level of the 
various operators who work in the print shop. This database can be coupled with 
queue management software which balances the loads/backlogs of job at each 
station 116. 

In the preflight stage 204, the documents can be assembled, such as in a 
book, annotated, edited, and have imposition or other page features applied. Once 
the documents are prepared for production, they are passed to the production stage 
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206. In the production stage 206, the prepared documents along with the 
production instructions (from the tickets) are submitted to the print server or 
directly to the production output device 122 using a file downloader such as the 
Print File Downloader™ application program manufactured by Heidelberg Digital, 
5 L.L.C., located in Rochester, New York. This user functionality workflow 116 

may be implemented as a combination of hardware, software and manually 
executed components and may involve one or more of the components detailed in 
the production printing workflow above. 

In the preferred embodiments, the user functionality workflow is preferably 
glO implemented as a workflow management software program and interface 

™ executing on the job preparation workstation 116. The preferred workflow 

03 management software is visually oriented using an object oriented graphic user 

M= interface ("GUI") approach which integrates control of the workflow functionality 

L5J in a single interface. While the visual and operational appearance of the 

* 15 management software is object oriented, the implementation of the software may 

q be by an object oriented programming language or a non-object oriented 

m programming language as are known in the art. 

2 In the GUI interface, documents, tickets and other entities and operations 

(collectively "objects") are visually represented on the workstation 116 display, 

20 such as with icons, tree structures and pull-down menus, and may be interacted 

with using known devices and methods such as utilizing a mouse or track ball to 
control a visually represented pointing device which is then used to click, select, 
drag and drop the displayed representations. Such manipulation of the visual 
representations results in manipulation of the underlying objects (documents, 

25 tickets, and other entities and operations). Furthermore, the GUI also permits 

creation and manipulation of relationships and associations among the various 
objects and visually displays such relationships and associations. Relationships 
and associations may be displayed, for example, using a hierarchical approach like 
a tree structure or file folder structure or using some alternate form of visual 

30 indication. It will be appreciated that graphic user interfaces are well known in the 

art and that there are many software development packages available which can be 
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used to develop a GUI. One such package is the Open Software Development Kit 
available from Microsoft Corporation, located in Redmond, Washington. 

Further, the preferred GUI utilizes a document centric approach providing a 
centralized viewing window for viewing documents being worked on. In the 
preferred embodiment, the document viewing functionality is provided by the 
Adobe Acrobat software program, manufactured by Adobe Systems, Inc., located 
in San Jose, California. 

As was noted above, the workflow management software integrates 
applications which implement, control or manage the stages of the production 
printing workflow 100. These applications include inputting documents from 
various sources, document assembly including the creation and manipulation of 
books, document editing, document annotation, document library access on the 
network server 118, setting and manipulation of page features, creation and 
manipulation of job tickets and printing. 

The workflow management software is capable of receiving input from 
various different sources. Such sources include hard copy originals input via a 
scanner, native application formats such as the Microsoft Office™ Product suite 
and desktop publishing applications such, as QuarkXpress™, manufactured by 
Quark. Inc., located in Denver, Colorado and FrameMaker™, manufactured by 
Adobe Systems, Inc., located in San Jose, California. Further the software can 
accept Tagged Image File Format ("TIFF") documents as well as documents 
already in a ready for printer format such as PDF, PS or PCL. For hard copy input 
via a scanner, the software supports industry standard scanner interfaces, TWAIN, 
as defined by the TWAIN group located in Boulder Creek, California and the 
Image and Scanner Interface Specification ("ISIS") developed by Pixel 
Translations, Inc., located in San Jose, California and also specified via American 
National Standards Institute specification ANSI/AIIM MS61-1996. Using these 
standard interfaces, the workflow management software receives the scanned 
image data directly in the ready for printer format. An exemplary scanner for use 
with the preferred workflow software is the Imagedirect™ Scanner manufactured 
by Heidelberg Digital, L.L.C., located in Rochester, New York. 

14 
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The preferred workflow management software also provides ODMA 
support for interfacing with document libraries. In addition, the provided ODMA 
support further extends the functionality of the document library to handle 
management, storage and archiving of compound documents (described below) 
and tickets. This allows libraries of standardized tickets to be created or facilitates 
updates and reprints of compound documents such as books. 

Once documents are loaded into the workflow management software, tools 
are provided to perform value added services and prepare the documents for 
production. Assembly is the process of arranging or rearranging pages or adding 
or removing pages within a document. Assembly also includes imposition where 
page positions are forced such as when the first page of a chapter is forced to the 
front side of the paper. The workflow management software provides cut, copy, 
paste and move functionality operable on 1 or more pages. This functionality is 
preferably implemented via pull-down menus, pop up dialog boxes or on screen 
option palates or buttons as provide by the graphic user interface. In addition, the 
results of the respective operations are shown in a visual representation of the 
document in the centralized document viewing window on the job preparation 
station 116 display. 

The workflow management software further provides support for editing 
and annotating the document. Tools are provided for image object area editing of 
a scanned page including erase inside and outside an area, cut, move, copy and 
paste area as well as pencil erase. Page editing tools are also provided for editing 
on one or more pages including area masking and cropping. Tools are also 
provided for annotating documents including alpha-numeric and graphic 
annotations. Exemplary annotations include page numbering and bates stamping. 
The tools further provide for placing images behind the document content, also 
known as watermarking. Annotation can be performed on any portion of one or 
more pages. For alpha-numeric annotations, the font size and style are 
controllable. In all cases, the results of the respective operations are shown in a 
visual representation of the document in the centralized document viewing 
window on the job preparation station 116 display. In the preferred embodiments, 
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edits or annotations can be created or manipulated by pointing to a visual 
representation of the document and/or pages within the document and selecting, 
dragging, dropping or clicking the representation and/or selecting from a menu of 
options, where the selection of a particular option causes the associated edit or 
annotation to be applied to the specified portions of the document. Alternatively, 
a palate of options may be displayed from which the user may choose an option to 
apply to selected portions of the document. Further, the interface may provide for 
a dialog box or other visual control for inputting control values for the edit or 
annotation such as the starting number of a bates range. 

The workflow management software preferably provides further support 
for compound documents which are documents comprised of one or more other 
documents, such as books comprised of chapters or course packs comprised of one 
or more excerpted sources. Compound documents take advantage of the object 
oriented nature of the workflow management software. A compound document 
("CD") is a collection of one or more documents which have a particular ordering 
to them such as the chapters of a book. The CD further contains an automatically 
generated assembled document which is a single document containing the whole 
assembled CD. Tools are provided which allow simple management of the 
documents of a CD, assembly and updating of the documents into the assembled 
document and selective document manipulation, such as selective printing, of the 
documents within the CD. Tools are also provided which can interpret the content 
of the documents within the CD arid automatically generate a table of contents in 
the assembled document. A compound document otherwise acts just like a 
document and can be edited, annotated, etc. and have tickets associated with it. 
Further, a compound document can contain other compound documents such as in 
the case of a multi-volume book. The individual documents and compound 
documents within the compound document further retain their independent 
existence and can be edited or printed independently of the CD and shared with 
other CD's with those edits being either automatically or manually updated into 
the assembled document within a particular CD. The workflow management 
software further displays a visual representation, such as with a hierarchical or tree 
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structure, showing the compound document and any associated documents and 
tickets. In the preferred embodiments, compound documents can be created or 
manipulated by pointing to the visual representations of one or more documents 
and/or a visual representation of a CD and selecting, dragging, dropping or 
clicking and/or selecting from a menu of options, where the selection of a 
particular option causes the associated feature to be applied to the selected 
documents or compound documents. Alternatively, a palate of options may be 
displayed from which the user may choose an option to apply to selected 
compound documents. Further, the interface may provide for a dialog box or 
other visual control for inputting control values for the compound documents such 
as margin values. For example, a user may select one or more documents and then 
choose a create CD option from a pull down menu. The workflow software then 
creates a visual representation of the CD on the display showing the association of 
the CD to the selected documents. Alternatively, the user may first create a visual 
representation of a CD and then drag and drop the visual representations of one or 
more documents onto the CD visual representation. The workflow software then 
creates the appropriate logical associations of the data for which the visual 
representations represent. 

The workflow management software is also preferably programmed with 
data about the different production output devices 122 in the print shop or 
otherwise available and their capabilities or other equipment, such as finishing 
equipment, which can be utilized either automatically or manually. The software 
provides tools which allow the operator to set page features/formatting which are 
made possible by those specific capabilities. Such page features include the plex 
of the document such as duplex or simplex (double sided or single sided output), 
binding options, such as stapling or hole punching and the availability and control 
settings for handling tab stock or ordered media. The preferred embodiments 
preferably support all of the features of the Digimaster™ line of high volume 
digital printers manufactured by Heidelberg Digital, L.L.C. located in Rochester, 
New York. In the preferred embodiments, these page features can be set by 
selecting or pointing to a visual representation of one or more pages and selecting 
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from a menu of options, where the selection of a particular option causes the 
associated feature to be applied to the selected pages. Alternatively, a palate of 
options may be displayed from which the user may choose an option to apply to 
selected pages. Further, the interface may provide for a dialog box or other visual 
5 control for inputting control values for the feature such as the type of tab stock. 

Setting page features for specific pages encodes instructions to the production 
output device 122 for implementing those features within the ready for printer 
formatted file. When the production output device 122 receives the file for 
printing, it will interpret those instructions to implement the desired feature. For 

10 page features which the current device 122 cannot handle, the device 122 can 

signal the operator that manual intervention is required and direct the operator 
through the appropriate steps to implement the page feature and complete the job. 
This may include instructing the operator to remove partially finished documents 
and transfer them to a binding machine for finishing or instructing the operator to 

15 load a specific media type or tab stock into the device 122. 

Tools are further provided by the workflow management software to 
support electronic versions of tickets for specifying production output device 
instructions and parameters, as well as other finishing steps which may or may not 
be automated, which are global to the document, e.g. job level features or global 

20 document attributes. These include such attributes as the general media type or 

color to use and the method of binding such as stapling. Tickets, also referred to 
as print tickets or job tickets, can exist independently of documents or compound 
documents as was mentioned above. They are independently visually represented 
on the display by the workflow management software. Tools are provided for 

25 manipulating tickets, such as saving, storing and associating them with documents 

or compound documents in addition to editing their options. In the preferred 
embodiments, tickets can be manipulated just like documents, using pointing, 
clicking, selecting, dragging and dropping. For example, a ticket can be 
associated with a document by selecting the ticket and dragging and dropping it on 

30 a particular document. The workflow management software then preferably 

visually displays the association by showing the ticket under the hierarchy of the 
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document. Once associated, the options set by the ticket will apply to the 
associated document or compound document. The options represented by the 
ticket may be set by selecting the ticket to bring up a dialog box or pull down 
option menu which displays the available options and allows modification of the 
option values. Tickets associated with documents can be manipulated with the 
document. For example, saving a document save all of its associated tickets. 
Furthermore, the workflow management software provides the capabilities to 
create libraries of standardized tickets which can be used, for example, to 
standardize procedures across multiple franchised print shops. 

Finally, the workflow management software provides tools to send the 
prepared documents and any associated tickets to the production output device for 
final production. In the preferred embodiments, documents or compound 
documents can be sent to a production output device by selecting, clicking or 
dragging the visual representation of the document or compound document to a 
visual representation of the print server or output device. Alternatively, the user 
may select an appropriate option from a pull-down menu, pop up dialog box or 
button palate. The workflow management software supports standard interfaces 
and protocols to production output devices and print servers. Further, tools are 
provided for managing, selecting and monitoring multiple production output 
devices. These tools provide visual feed back of each of the devices status to the 
user such as the current job queues. 

As described above, once a document or job is ready to be produced, i.e. 
has been through job preparation 106 and the pre- flight stage 204 of the workflow, 
it is transmitted to the production stage 206 of the workflow for final fulfillment 
1 10 and output on the production output device 122. While at this stage, the 
document/job should be perfect and ready to be printed, errors can and often still 
occur in the process. Such errors may result from operator error or oversight 
during job preparation 106 or from data or transmission errors as the job is moved 
from stage to stage around the print shop's network. Often, these errors comprise 
either an incorrectly applied page feature (described in more detail below) or a 
defect in the original document which could have been corrected by the addition 
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or modification of a page feature but either the page feature was never 
added/modified or somehow got removed or reverted to its original state. These 
errors represent latent defects which may not be caught until the finished output is 
proofed. The production stage 206 therefore represents the last opportunity to 
correct any such latent defects in the job before the actual physical generation of 
the output, i.e. the last opportunity to "soft-proof the job. As was noted, an 
undetected or uncorrected error/defect in a particular job can result in a significant 
waste of the print shop's resources, including wasted media, wasted machine time 
and wasted operator time. In addition, these errant jobs incur the cost of sending 
the job back through job preparation 106 and the pre-flight stage 204 to correct the 
errors. This cost can be significant depending on the organization of the print 
shop and the location and work load on the job preparation stations 116 and their 
operators. Therefore, it is advantageous to provide a system for allowing an 
operator of a production output device to perform a final review of a job prior to 
its production and allow for any necessary corrections or adjustments. 

Referring back to Figure 2, the production output device 122, which is 
preferably a Digimaster™ Digital High Volume Printer manufactured by 
Heidelberg Digital, L.L.C., located in Rochester, New York, further comprises an 
operator console 210 for controlling the production output device 122. The 
operator console 210 includes control input devices (not shown) such as a 
keyboard, mouse, trackball, touch pad, control buttons, knobs or sliders or other 
input control devices as are known in the art. The operator console 210 further 
includes a display output device 212 such as a CRT or LCD flat panel display, 
which may or may not be a touch sensitive input device as well. The display 
output device 212 displays status and control information about the production 
output device 122 and accepts input commands from the operator utilizing a 
graphic user interface coupled with the control input devices. 

Referring now to Figure 3, there is shown a first embodiment of a graphic 
user interface 300 for use on the display output device 212. The interface 300 
includes a button palette 302 and a page display window 316. The button palette 
300 comprises control buttons 318 which control the various features and options 
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of the interface 300. Exemplary buttons 318 and their functions include a "new" 
document button, an "open" document button, a "save/save as" document button, 
"print" document button, "cut", "copy", "paste" editing buttons and document and 
file navigation buttons as are known in the art. These buttons 318 may be 
interacted with using an input device such as a mouse, keyboard, or touch 
sensitive display 212. It will be appreciated by one of ordinary skill in the art that 
such button palettes 302 are well known and may be implemented in many ways 
and that the functionality of the buttons 318 may be alternatively implemented in 
other ways including keyboard based key sequences, menus and dialog boxes. 
The page display window 316 displays the current document which is being 
worked on. At any given time, a production output device 122 may have multiple 
jobs stored in an internal print queue/storage queued up for production. The 
interface 300 allows the operator to choose which job to work on and produce. 
This current job is displayed in the page display window 3 16 as described below. 

The page display window 316 displays a visual representation of the 
document which is being produced. As shown in the figure, one way to display 
the document is to show four thumbnail images 304A-D of four pages of the 
document on the screen at a given time. The thumbnail image 304A-D shows a 
miniature representation of the page as it will look when it is printed, including 
representations of the content and formatting of the document. The operator can 
scroll through all of the pages of the document, four at a time, using the control 
buttons 318 in the button palette 302 (or alternatively, a scroll bar, scroll wheel or 
other navigation devices which are known in the art) and view all of the pages 
contained within the document. Alternatively, the page display window 316 can 
display more or less than four thumbnail images 304A-D, can display larger or 
smaller thumbnails images 304A-D, can display a single full page at various 
magnification levels and can be expanded to a full screen mode to utilize the full 
display area of the display output device 212. In full screen mode, the button 
palette 302 can be converted to a floating button palette 302 which hovers above 
the full screen display or can be hidden and triggered to appear when needed by 
the operator. 
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The page display window 316 allows the operator to see a quick summary 
of the page features applied to each of the pages of a particular document. As was 
discussed above, such page features include formatting attributes such as text 
margins, type fonts/styles, text alignment, text orientation and line and page 
breaks. Page features further include media attributes such as whether the paper is 
pre-hole punched or not, media size (letter, legal, A4, etc.), media color, media 
finish (glossy, matte, texture, etc.), media thickness and media type such as tab or 
card stock. Finally, the various page features also include finishing (imaging or 
printing) attributes such as media source, page image cropping, page image 
shifting (such as for binder's creep compensation), masking, plex (simplex or 
duplex), annotation (page numbers, bates numbers, watermarks), insertion 
(alternate media such as tab stock or colored media), re-ordering, imposition, and 
binding such as stapling, hole punching or book binding. 

As shown in the exemplary embodiment, the page display window shows 
four page representations 304A-D of four pages of the current document. In the 
preferred embodiment, these page representations 304A-D are thumbnail or 
miniature images 304A-D of the particular pages. When the operator wishes to 
view the page features which have been applied to a particular page (or group of 
pages) of the document, he/she selects the desired page (or group of pages) using 
an input device as described above to select the corresponding thumbnail image 
304A-D. It will be appreciated that selection mechanisms in graphic user 
interfaces are well known. The interface 300 reflects the selection of a page by 
placing a selection indicator 306 on the selected page such as a darkened border or 
other visual indicator showing that a particular page (or group of pages) is 
selected. Once selected, a menu 308 can be viewed which lists descriptors 310 of 
the various available page features 310 along with an indicator for each feature 
310 which indicates whether or not the particular page feature 310 applies to the 
selected page(s). Preferably, this menu 308 is displayed when an operator clicks a 
button, such as a right mouse button, located on a mouse type pointing device. In 
alternative embodiments, the menu 308 can be displayed automatically when a 
thumbnail image 304A-D is selected or can be displayed when an input key or 
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button is pressed. Further, where the operator console 210 provides a pointing 
device, the menu 308 can be displayed when the displayed pointer is manipulated 
over a particular thumbnail image 304A-D (whether or not the thumbnail image 
304A-D is selected). 

As described above, the menu 308 lists descriptors 310 or descriptive text 
of the various available page features 310. Associated with each descriptor is an 
indicator 312 which is binary in operation and indicates whether or not the 
particular page feature has been set for the selected thumbnail image 304A-D. If 
the indicator 3 12 is asserted, this means that the particular page feature has been 
applied to the page represented by the thumbnail image 304A-D. If the indicator 
3 12 is de-asserted, then the particular page feature has not been applied. In one 
embodiment, the indicator 3 12 is a check box which represents assertion of the 
indicator 312 with a check symbol 314. It will be appreciated that there are many 
different ways to visually indicate such a binary value. Further, many page 
features have various optional values associated with them. For example, the plex 
page feature has the possible values of simplex or duplex. Further, the shifting 
page feature has a value representing the degree and direction of image shift. In 
an alternative embodiment, these values can also be displayed in the menu 308 as 
associated with the page feature descriptor 310 and in place of, or in conjunction 
with, the indicator 312. 

In another alternative embodiment, the operator can use the operator 
console 210 to select a page feature descriptor 310 from the menu 308. Such a 
selection can bring up a dialog box (not shown) which allows application or 
removal of the particular page feature and setting of any optional values. Further, 
the interface 300 allows formatting and other modifications to the page features of 
the document to be globally applied to the entire document, such as a shifted 
margin, or only applied to select pages. Further, in still another alternative 
embodiment, the interface 300 can also detect conflicts between page features and 
page features which are improperly set. For example, the interface 300 can 
determine that an annotation has been placed so as to run off the edge of the 
media. Further, the interface 300 can detect that both stapling and three hole 
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punching have been selected and that the staples are positioned in the same 
location as the hole punches. Such errors can be flagged such as through an error 
indicator, dialog box or other warning which informs the operator of the error and 
allows him to correct it. 

In this way, the operator can preview the pages of a document along with 
the page features that have been set and determine if everything is correct for final 
production. If there are errors, the operator can immediately correct the errors 
without having to return the job to the job preparation stations 116. The 
corrections can be immediately made and previewed for correctness and then the 
job can be produced on the production output device 122. 

Referring to Figure 4, there is shown a second embodiment of a graphic 
user interface 400 for use on the display output device 212. The interface 400 is 
identical to the interface 300 and includes a button palette 402 with buttons 420 
and a page display window 418 which shows thumbnail images 404 A-D 
representing the pages of the document to be produced. Further, interface 400 
provides for a symbolic attribute representation or representative icons of the 
applied page features (media/finishing attributes) to be displayed in conjunction 
with the thumbnail images 404A-D. The application of particular page features is 
visually represented in the page display window 418 on the corresponding 
thumbnail image 404A-D. For example, application of a page feature for three 
hole punching would cause visual representations of the holes 412 in the pages to 
appear on the thumbnail image 404B of the selected pages. This would allow the 
operator to see the results of the page feature and determine, for example, if the 
body text of the page is too close to the holes. 

Each page feature or media/finishing attribute is associated with an icon or 
symbolic attribute representation which can be overlaid on the thumbnail image 
404A-D. Other examples include displaying a tab 406 on the thumbnail image 
404A to indicate that the particular page is to be printed on tab stock, displaying 
the thumbnail image 404B in a particular grayscale, pattern or color 414 to 
indicate that the page is to be printed on a certain color media, displaying staple 
symbols 408 on the thumbnail image 404C to indicate the location for stapling and 
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displaying a margin guide 410 on the thumbnail image 404D to indicate image 
shifting. Where a symbolic attribute representation cannot be easily inserted or 
intuitively displayed with the thumbnail image 404 A-D, an icon 416 can be 
displayed next to the thumbnail image 404A-D to indicate the presence of the 
particular page feature. For example, and icon 416 can be displayed next to the 
thumbnail image 404B to indicate a page insertion. In this particular example, 
additional information can be displayed next to, or otherwise in conjunction with, 
the icon 416 indicating, for example, the page number of the inserted page(s) 
relative to the number of total pages in the document to indicate the to the operator 
the impact on the page count of the insertion. It will be appreciated that each of 
the symbolic attribute representations and icons can be displayed alone or in 
combination with others to reflect the combination of page features applied to the 
particular page. Further, the symbolic attribute representations/icons, or 
combinations thereof, can further be displayed in conjunction with status or 
settings data indicating to the operator information about the applied page features. 
Note that while the page features are visible in the page display window 418, they 
are inserted in the ready for printer format code so as not to actually print out 
when the document is sent to the production output device. The logic which 
implements the symbolic representations of the page and document features knows 
of the capabilities and operations of the production output device 122. For 
example, the logic knows that the automatic stapler in the production output 
device 122 can only staple along the left edge of the paper. Therefore, if the job 
calls for stapling along the right edge, an error can be flagged. 

Particular page features can be added, deleted or modified by pointing to 
the symbolic attribute representation or icon with the pointing device and selecting 
it to bring up a dialog box for controlling the particular feature. Further, menus or 
buttons can be provided which list the available page features and offer the ability 
to apply a particular page feature to a selected page representation 404A-D or 
group of selected page representations 404A-D. Alternatively, the interface 400 
can be combined with the interface 300 to offer a pop-up menu 308 for viewing, 
selecting, adding and modifying page features in conjunction with the symbolic 
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attribute representations displayed in conjunction with the page representations 
404A-D. For example, using the input device to select or click on an 
icon/symbolic attribute representation can display a pop up menu or dialog box 
allowing the user to configure or modify the represented page feature. 

Referring to Figure 5, there are shown symbolic attribute representations or 
icons corresponding to various other page features, which include media and 
finishing attributes, which can be used with the disclosed embodiments. Such 
icons/features include chapters 502 which indicates the application of a form of 
imposition where the first page of chapter is forced to be the front page of a double 
sided page, copy improvement 504 which indicates the application of special 
filters or image processing algorithms to enhance the reproduction of the particular 
page (for photographs, etc.), page insertion 506 which shows that a photo, tab or 
other page is inserted at the indicated point (similar to the icon 416 in Figure 4), 
overlay 508 indicating the application of an image or text overlay or watermark 
and sub-set stapling 510 indicating that a sub-set(s) of the pages within the 
document are to be stapled or stapled differently than the remaining pages of the 
document (this is similar and can be combined with icon 408 in Figure 4 which 
can be used to show stapling all the way through the entire document. Other page 
features that can also be represented are edge erase (representative icons not 
shown in figure). It will be appreciated that there are many different ways to 
visually represent the various page features and that the disclosed embodiments 
are applicable to page features and icons presently existing and later developed. 

It will further be appreciated that the graphic user interface 300/400 may 
also be implemented as a remote interface to the production output device 122 
allowing control of the production output device 122 from a remote location. In 
one alternative embodiment, the graphic user interface is implemented as a client 
using Hypertext Markup Language ("HTML") and Hypertext Transport Protocol 
("HTTP") layered on a Transport Control Protocol/Internet Protocol ("TCP/IP") 
based network to communicate with an HTTP server located in the production 
output device 122. 
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It is therefore intended that the foregoing detailed description be regarded 
as illustrative rather than limiting, and that it be understood that it is the following 
claims, including all equivalents, that are intended to define the spirit and scope of 
this invention. 
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